Skip to content

Improving normalization patterns#968

Open
Gwynbleidd0241 wants to merge 5 commits into
masterfrom
967-upgrade-patterns
Open

Improving normalization patterns#968
Gwynbleidd0241 wants to merge 5 commits into
masterfrom
967-upgrade-patterns

Conversation

@Gwynbleidd0241
Copy link
Copy Markdown
Collaborator

No description provided.

@Gwynbleidd0241
Copy link
Copy Markdown
Collaborator Author

Gwynbleidd0241 commented Apr 24, 2026

Предыдущая реализация:

BenchmarkTokenNormalizer/input_len_392-12         	  210090	      5693 ns/op	   11808 B/op	      74 allocs/op
BenchmarkTokenNormalizer/input_len_3920-12        	   16477	     69961 ns/op	  115825 B/op	     677 allocs/op
BenchmarkTokenNormalizer/input_len_39200-12       	    2139	    549695 ns/op	 1131223 B/op	    6707 allocs/op
PASS
ok  	github.com/ozontech/file.d/plugin/action/hash/normalize	8.793s

Обновленная реализация:

BenchmarkTokenNormalizer/input_len_392-12         	  205298	      5874 ns/op	   11968 B/op	      76 allocs/op
BenchmarkTokenNormalizer/input_len_3920-12        	   21013	     57347 ns/op	  117424 B/op	     697 allocs/op
BenchmarkTokenNormalizer/input_len_39200-12       	    2085	    579986 ns/op	 1147227 B/op	    6907 allocs/op
PASS
ok  	github.com/ozontech/file.d/plugin/action/hash/normalize	8.305s  

@Gwynbleidd0241
Copy link
Copy Markdown
Collaborator Author

Предыдущая реализация, протестированная 6 раз на больших входных данных:

BenchmarkTokenNormalizer/input_len_39200-12         	    2073	    570496 ns/op	 1131220 B/op	    6707 allocs/op
BenchmarkTokenNormalizer/input_len_39200#01-12      	    2089	    562066 ns/op	 1131217 B/op	    6707 allocs/op
BenchmarkTokenNormalizer/input_len_39200#02-12      	    2152	    577321 ns/op	 1131219 B/op	    6707 allocs/op
BenchmarkTokenNormalizer/input_len_39200#03-12      	    2109	    570104 ns/op	 1131217 B/op	    6707 allocs/op
BenchmarkTokenNormalizer/input_len_39200#04-12      	    2101	    570746 ns/op	 1131217 B/op	    6707 allocs/op
BenchmarkTokenNormalizer/input_len_39200#05-12      	    2088	    662102 ns/op	 1131217 B/op	    6707 allocs/op

Аналогичное тестирование на обновленной реализации:

BenchmarkTokenNormalizer/input_len_39200-12         	    2114	    569913 ns/op	 1147217 B/op	    6907 allocs/op
BenchmarkTokenNormalizer/input_len_39200#01-12      	    2089	    577766 ns/op	 1147217 B/op	    6907 allocs/op
BenchmarkTokenNormalizer/input_len_39200#02-12      	    2078	    578311 ns/op	 1147217 B/op	    6907 allocs/op
BenchmarkTokenNormalizer/input_len_39200#03-12      	    2067	    571776 ns/op	 1147218 B/op	    6907 allocs/op
BenchmarkTokenNormalizer/input_len_39200#04-12      	    2121	    580521 ns/op	 1147217 B/op	    6907 allocs/op
BenchmarkTokenNormalizer/input_len_39200#05-12      	    2046	    588864 ns/op	 1147218 B/op	    6907 allocs/op

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants